Performance of ChatGPT on Chinese Master's Degree Entrance Examination in Clinical Medicine.

BACKGROUND: ChatGPT is a large language model designed to generate responses based on a contextual understanding of user queries and requests. This study utilised the entrance examination for the Master of Clinical Medicine in Traditional Chinese Medicine to assesses the reliability and practicality of ChatGPT within the domain of medical education. METHODS: We selected 330 single and multiple-choice questions from the 2021 and 2022 Chinese Master of Clinical Medicine comprehensive examinations, which did not include any images or tables. To ensure the test's accuracy and authenticity, we preserved the original format of the query and alternative test texts, without any modifications or explanations. RESULTS: Both ChatGPT3.5 and GPT-4 attained average scores surpassing the admission threshold. Noteworthy is that ChatGPT achieved the highest score in the Medical Humanities section, boasting a correct rate of 93.75%. However, it is worth noting that ChatGPT3.5 exhibited the lowest accuracy percentage of 37.5% in the Pathology division, while GPT-4 also displayed a relatively lower correctness percentage of 60.23% in the Biochemistry section. An analysis of sub-questions revealed that ChatGPT demonstrates superior performance in handling single-choice questions but performs poorly in multiple-choice questions. CONCLUSION: ChatGPT exhibits a degree of medical knowledge and the capacity to aid in diagnosing and treating diseases. Nevertheless, enhancements are warranted to address its accuracy and reliability limitations. Imperatively, rigorous evaluation and oversight must accompany its utilization, accompanied by proactive measures to surmount prevailing constraints.

Effectiveness and Safety of Chinese Herbal Injections Combined with SOX Chemotherapy Regimens for Advanced Gastric Cancer: a Bayesian Network Meta-Analysis.

Background: Randomized controlled trials (RCTs) have demonstrated that combining Chinese herbal injections (CHIs) with oxaliplatin plus tegafur (SOX) chemotherapy regimens improves clinical effectiveness and reduces adverse reactions in patients with advanced gastric cancer (AGC). These RCTs highlight the potential applications of CHIs and their impact on AGC patient prognosis. However, there is insufficient comparative evidence on the clinical effectiveness and safety of different CHIs when combined with SOX. Therefore, we performed a network meta-analysis to rank the clinical effectiveness and safety of different CHIs when combined with SOX chemotherapy regimens. This study aimed to provide evidence for selecting appropriate CHIs in the treatment of patients with AGC. Methods: We searched eight databases from their inception until March 2023. Surface Under the Cumulative Ranking Curve (SUCRA) probability values were used to rank the treatment measures, and the Confidence in Network Meta-Analysis (CINeMA) software assessed the grading of evidence. Results: A total of 51 RCTs involving 3,703 AGC patients were identified. Huachansu injections + SOX demonstrated the highest clinical effectiveness (SUCRA: 78.17%), significantly reducing the incidence of leukopenia (93.35%), thrombocytopenia (80.19%), and nausea and vomiting (95.15%). Shenfu injections + SOX improved Karnofsky's Performance Status (75.59%) and showed a significant reduction in peripheral neurotoxicity incidence (88.26%). Aidi injections + SOX were most effective in reducing the incidence of liver function damage (75.16%). According to CINeMA, most confidence rating results were classified as "low". Conclusion: The combination of CHIs and SOX shows promising effects in the treatment of AGC compared to SOX alone. Huachansu and Shenfu injections offer the greatest overall advantage among the CHIs, while Aidi injections are optimal for reducing the incidence of liver damage. However, further rigorous RCTs with larger sample sizes and additional pharmacological studies are necessary to reinforce these findings.

Comparative effectiveness and safety of Chinese medicine belly button application for childhood diarrhea: a Bayesian network meta-analysis of randomized controlled trials.

Background: Chinese medicine belly button application (CMBBA) has been used to treat childhood diarrhea (CD) in several randomized controlled trials (RCTs), but its effectiveness and combination strategy still need to be clarified. Therefore, we aimed to evaluate the effectiveness, safety, and the optimal combination strategy of CMBBA in treating CD. Methods: Up until January 2023, we searched for studies that met our inclusion criteria in six databases, including PubMed, the Cochrane Library, Chinese SinoMed, CNKI, VIP, and Wanfang. Heterogeneity was quantified using I2 statistics. A methodological evaluation was performed using the Cochrane Risk Bias Tool 2.0. The Confidence in Network Meta-Analysis online software was employed to evaluate evidence grading. A minimally contextualized framework was used to provide a comprehensive conclusion for the network meta-analysis. This study protocol was registered with PROSPERO. Results: We analyzed data from 33 RCTs that included 4,490 children with diarrhea. In terms of clinical effectiveness, CMBBA plus montmorillonite powder plus anti-infectives may be the most effective treatment option for children with diarrhea and concurrent infection according to a minimally contextualized framework. Either exclusive use of CMBBA or CMBBA in combination with modern medicine was beneficial in reducing the time to diarrhea disappearance (MD = -1.33 days, 95% CI: -1.59 to -1.08, Z = -10.103, p < 0.001) compared to modern medicine exclusively, and the difference was statistically significant. The combined usage of CMBBA could shorten the recovery time of dehydration by an average of 0.74 days (MD = -0.74 days, 95% CI: -1.10 to -0.37, Z = -3.931.103, p < 0.001). While some studies have reported mild allergic reactions and mild abdominal pain after CMBBA use, these symptoms can be cured in a relatively short period of time. Conclusions: The combination of CMBBA, montmorillonite powder, and anti-infectives may provide superior clinical effectiveness for children with diarrhea and concurrent infection. To treat CD, CMBBA can be used effectively and safely. However, the findings must be interpreted with cautiously due to the limited number of clinical trials and the low quality of the studies. In addition, the choice of treatment plan should also be based on the specific conditions of each patient. Systematic Review Registration: https://www.crd.york.ac.uk/prospero/, identifier: CRD42022380694.